CLT for linear spectral statistics of random 

matrix S _1 T 

Shurong Zheng*, Zhidong Bai* and Jianfeng Yao** 
* School of Mathematics and Statistics and KLAS, Northeast Normal University, 
Changchun City 130024, P. R. China 
** Department of Statistics and Actuarial Science, Hong Kong University, P. R. China 

May 8, 2013 



Abstract 

As a generalization of the univariate Fisher statistic, random Fisher matrices 
are widely-used in multivariate statistical analysis, e.g. for testing the equality of 
two multivariate population covariance matrices. The asymptotic distributions of 
several meaningful test statistics depend on the related Fisher matrices. Such Fisher 
matrices have the form F = SyMS^T 1 M* where M is a non-negative and non-random 
Hermitian matrix, and S x and S y are p x p sample covariance matrices from two 
independent samples where the populations are assumed centred and normalized 
(i.e. me an 0, variance 1 and with independent components). In the large-dimensional 



context. IZheneJ ((2012J) establishes a central limit theorem for linear spectral statistics 
of a standard Fisher matrix where the two population covariance matrices are equal, 
i.e. the matrix M is the identity matrix and F = S^S" 1 . It is however of significant 
importance to obtain a CLT for general Fisher matrices F with an arbitrary M 
matrix. For the mentioned test of equality, null distributions of test statistics rely on 
a standard Fisher matrix with M = I p while under the alternative hypothesis, these 
distributions depends on a general Fisher matrix with arbitrary M. As a first step 
to this goal, we propose in this paper a CLT for spectral statistics of the random 
matrix S~ X T for a general non-negative definite and non-random Hermitian matrix 
T (note that T plays the role of M*M). When T is i nversi ble, such a CLT can be 



directly derived using the CLT of 



Bai and Silversteinl (J200J) for the matrix T 1 S X . 



However, in many large-dimensional statistic problems, the deterministic matrix T 
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is usually not inversible or has eigenvalues close to zero. The CLT from this paper 
covers this general situation. 



1 Introduction 



For a p x p random matrix A n with eigenvalues (Xj), linear spectral statistics (LSS) of 
type f(Xj) for various test functions / are of central importance in the theory of 

random matrices and its applications Central limit theorems (CLT) for such LSS of large 
dimensional random matrices have a long history, and received considerable attention in 
recent years. They have important applications in various domains like number theory, 



high-dimensional multivariate statistics and wireless communicati on networ 



Johnstone 



£ s; for more 
((2003). To 
••,tr(A*)) 



information, the readers are referr ed to th e recen t survey paper 
mention a few, in an early work, iJonssonl (119821 ) gave a CLT for (tr(A n 
for a sequence of Wishart matrices (A n ), where k is a fixed number, and the dimension 
y of the matrices grows pro p ortionally t o the sample size n. Subsequent works include 
Costin and Lebowitzl (119951). I Johansson! (|19981 ) which considered extensions of classical 

where Gaussian fluctuations are 



Gaussian ensembles, and 



Sinai and Soshnikov 



(11998a 



ft 



identified for LSS of Wigner matrices with a class of more general tes t functions. A gen- 
eral CLT for LSS of Wigner matrices was given in If3ai and Yao ( 2005 ) where in partiular. 



the lim iting mean and covariance functions are identified. Similarly, iBai and Silverstein 
(120041 ) establis hed a CLT for gene r al sa mple covariance matrices with explicit limiting 
parameters. In iLytova and Pasturl (120091 ). the authors reconsider such CLTs but with a 
new idea of interpolation that allows the generalisation from Gaussian matrix ensembles 
to matrix ensembles wi th general entr ie s sati sfying a moment condtiion. Recent improv- 



lii 



r erstein] (2004 ) (see 
Pan and 



m ents are proposed i n IPan and Zhoul ( 2008) that propose a generalization of the CLT 



Wang and Yao (j2013 ) for a complement o n the se 



Bai and Zheng! (120131 ) extend IBai and Silverstein! (120041 ) 's 



CLT's). Finally, 

CLT to biased and unbiased sample covariance matrices, respectively. 

Random Fisher matrices are widely-used in multivariate statistical analysis, e.g. for 
testing the equality of two multivariate population covariance matrices. The asymptotic 
distributions of several meaningful test statistics depend on the related Fisher matrices. 
Such Fisher matrices have the form F = S^MS^M* where M is a non-negative deter- 
ministic Hermitian matrix, and S x and are p x p sample covariance matrices from 
two independent samples where the populations are assumed centred and normalized (i.e. 
mean 0, variance 1 and with independent components). In the large-dimesional context, 
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Zhengl (120121 ) establishes a CLT for linear spectral statistics of a standard Fisher matrix 



where the two population covariance matrices are equal, i.e. the matrix M is the identity 
matrix and F = S^S" 1 . It is however of significant importance to obtain a CLT for general 
Fisher matrices F with an arbitrary M matrix. For the mentioned test of equality, null 
distributions of test statistics rely on a standard Fisher matrix with M = I p while under 
the alternative hypothesis, these distributions depends on a general Fisher matrix with 
arbitrary M. 



In order to extend the CLT of 



Zhengl (120 12l ) to general Fisher matrices, we first need to 



establish limit theorems for the spectral (eigenvalues) distribution of the matrix MS a 7 1 M*, 
or the matrix S~ X T where T = M*M is non-random. This includes i) an identifiation of 
the limit of its spectral distribution; ii) a CLT for its LSS. When the non-random matrix 
T is in yersible, since S~ lr T = [T ~ 1 S. r ] \ CLT for LSS of S~ X T can be derived from the 
CLT of 



Bai and Silversteinl (120041 ). However, in many large-dimensional statistic problems, 



the deterministic matrix T is usually not invertible or has eigenvalues c l ose to zero, and it 
is then hopeless to base the analysis on the CLT of iBai and Silversteinl (120041 ) . 

In this paper, we consider the product S~ X T of a general determinist and non-random 
Hermitian matrix T by the inverse S" 1 of a standard sample covariance matrix. As the 
main results of the paper, solutions to the aforementioned problems are provided. 

The organization of this paper is as follows. Section [2] presents our main results. The 
proofs of these two main theorems are given in the following sections, respectively. 



2 Main results 



Following IBai and Silversteinl ( 120041 ). let {xj}, t — 1, . . . , n be a sequence of indepenent 
p-dimensional observations with independent and standardised components, i.e. for x t = 
(xtj), Extj = and E|x^| 2 = 1. The corresponding sample covariance matrix is 



n 



n 



f2.r 



t=i 



Consider the product matrix 



s -i T 



n 

. t=i 



(2.2) 



where T is a p x p non-negative definite and non-random Hermitian matrix. Notice that 
we do not ask T be invertible. 

We first state the framework for our main results. 
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Assumption 1 The p x n observation matrix (xtj,t = 1, • • • , n,j = 1, • • • ,p) are made 
with independent elements satisfying Ex t j = 0, E|x tJ | 2 = 1. Moreover, for any rj > 
and as p, n — > oo, 

-EE E hi 2 w^]^°- ( 2 - 3 ) 

^ t=i j=i 

where /{.} is the indicator function. 

The elements are either all real or all complex and we set an index k = 1 or k = 2, 
respectively. In the later case, E{a£} = for all t,j. 

Assumption 1* In addition to Assumption 1, the entries {xtj} have an uniform 4-th 
moment E|x t j| 4 = 1 + n. Moreover, for any r\ > and as p, n — > oo, 

- n p 

-EE e 0^i%i^i>^}]^°- (2.4) 

y t=l j=l 

Assumption 1** In addition to Assumption 1, the entries {x t j} have a finite 4-th moment 
(not necessarily the same). Moreover, for any r\ > and as p, n — > oo, 

^ n p 

-EE E 0^| 4 ^l>^}]^0- (2-5) 

y t=l j=l 

Assumption 2 The ESD H n of {T} tends to a limit H, which is a probability measure 
not degenerated to the Dirac mass at 0. 

Assumption 2* In addition to Assumption 2, the operator norm of T is bounded when 
n, p — > oo. 

Assumption 3 The dimension p and the sample size n both tend to infinity such that 
p/n^ye (0,1). 

Assumption 1 states that the entries are independent, not necessarily identically dis- 
tributed, but with homogeneous moments of first and second order, together with a Lin- 
deberg type condition of order 2. Assumption 1* reinforce Assumption 1 with similar 
condtions using a homogeneous forth order moment that matches the Gaussian case. As- 
sumption 1** generalizes the previous one by allowing arbitrary values for the fourth mo- 
ment of the entries. 

Recall that the empirical spectral distribution (ESD) of a matrix is the distribution 
generated by its eigenvalues. When this ESD has a limit when the dimensions grow to 
infinity, the limit is called the limiting spectral distribution (LSD) of the matrix. 

The first main result of the paper identifies the LSD of S _1 T. 
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Theorem 2.1 Under Assumptions 1, 2 and 3, with probability 1, the ESD F n of S _1 T 
tends to a non-random distribution F y,H whose Stieltjes transform s(z) is the unique solu- 
tion to the equation 

zs(z) = -1 + / tdH 2 {t K^ + ■ (2-6) 

J -z -yz 2 s(z) +t 

The distribution F^ H is then the LSD o/S _1 T. 
Next, we consider a LSS of S _1 T of form 



where the l Ajl's are the eigenvalues of the matrix S _1 T and / a given test function. 
Similarly to lBai and Silversteinl ( 120041 ) . a special feature here is that fluctuations of F n (f) 
will not be considered around the LSD limit F y,H (f), but around F Vn '(f), a finite- 
sample proxy of F y ' H obtained by substituting the parameters (y n , H n ) to (y, H) in the 
LSD. Therefore, we consider the random variable 



X n (f) = p [F n (f) - F»» H »(fj\ = p J f(x)d[F n - F*» H »]( 
The second main result of the paper is the following CLT. 



Theorem 2.2 Assume that Assumptions 1* , 2* and 3 hold. Let /i, • • • , fk be functions 
analytic on an open domain of the complex plane enclosing the interval 



'liminf A£,„ hmsupA 



T n 

max 



where A^ in and A^ ax are respectively the smallest and the largest eigenvalue ofT. Then, the 



random vector [X n (fi), 
with mean function 



and covariance function 
Cov(X h ,X f .)-- 



■ X n (fk)] weakly converges to a Gaussian vector [X^, ■ ■ ■ ,X 



K-l 

2ni 



r t{l+yzs{z)fdH{t) 
yj (t/z-l-yzs(z)) 3 

_ f (l+yzs(z))*dH(t) 
y J (t/z-l-yzs(z)) 2 



K 



4vr 2 



f (z ) f (z ) ■ dMi+^isQi))] d[z2(l+yz 2 s(z 2 ))} 
Ji\ i)Jj\ 2) Q Zl g Z2 

[zi(l + yzis(zi)) - z 2 (l + yz 2 s(z 2 ))] 2 



fk i 



(2.7) 



dz\dz 2 (2.1 



_„ r (i+yzs(z))2dH(t) \ 

V UJ (tlz-l-yzs(z)V J 



(t/ z-l-yzs{z)y 

are closed and are taken in the positive direction in the complex plane, all enclosing the 
support of F y ' H . 

When the fourth moments of the entries are different from the value k + 1 matching 
the Gaussian case (3 or 2), the expression (14. 5 j) has an additional term 
i n p 



and the expression (I4.14p has an additional term 

E(/?iW) 2 



n 2 y 



3=1 



Then the covariance (14. 9p and mean (14.161) will have additional terms, the limits of 



d 2 {^E biizMzs) E(E|^| 4 - 1 - k) E,_! (z?T - S,) 



i=i 



-i 



Ei_x (z 2 ^T - S^ 1 



dz\dz2 



and 



y(l+yzs(z)) 3 



■ I E <! (^l x ijl 4 - 1 - «) (2 X T - Si) 

V yJ (t/z-l-yzs(z)) 2 I j = l 



33 



{z- l T - Si) -1 T {z~ l T - Ef3 l (z)l)~ 1 



33 



When iE(^l^il 4 - 1 
i=i 



re 



zi : T — S^ 1 (z2 X T — Si) 1 converges to h(zi, z 2 ) 
- 33 L J j j 

uniformly in z, then the covariance H4.9I) will have the additional term 

d 2 [y ■ (1 + yzis(zi))(l + y3 2 g(z2))h(zi, 3a)] 

because Ebi(z) -> 1 + yzs(z) by (14.251) . 

Then Theorem 12.21 is easily extended to this situation as follows. 

Proposition 2.1 Assume that Assumptions 1** , 2* and 3 hold. Let /1, • • • , fk be functions 
analytic on an open domain of the complex plane enclosing the interval 



liminfA^ limsupA 



T -1 

max 
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where A^ in and A^ ax are respectively the smallest and the largest eigenvalue o/T. Moreover, 
assume in addition that the following non-random limits exist: 



i- 1 p E(e\x^-i-k) 

3=1 

uniformly in i; 



(z 1 ~ 1 T - S,)- 1 ] \{z 2 - lr I - S 



33 



,-1 



converges to h(z\,z 2 ) 



33 



2- i£W^| 4 -l-*0 (z~ 1 T-S 1 

3=1 l 



,-1 



con- 



33 



[z~ l T - Si) -1 T {z~ l T - E^z)!)' 1 

L J 33 L 

verges to h M (z). 

Then the random vector [X n (fi), • • • , X n (fk)] weakly converges to a Gaussian vector [Xf i: • • • , Xf k ] 
with mean function 

r t{l+yzs{z)fdH{t) 

i yj (t/z-i- 



~EX t 



K - 1 

2vri 
1 



(tj z-l-yzs(z)) 3 



rdz, 



Z 2 A . r (l+yzs(z)) 2 dH(t) \ 2 



^ y I (t/z-l-yzs(z)j 2 J 

y(l + yzs(z)) 3 



2lii I JJV ' / .2(1 _,. f 

Z ^ yj (t/z-l-yzs(z)) 2 J 

and covariance function 

I f fi(zi) fj(z 2 ) ■ d[z2(l+yz 2 s(z 2 ))] 



h M (z)dz 



1 



fi(zi)fj{z 2 ) 



d 2 [y ■ (1 + y^is(zi))(l + yz 2 s(z 2 ))h(z 1 , z 2 )\ 



dz\dz 2 . 



4vr 2 / j ■"■\~'-jj3\~*j dz 1 dz 2 
The contours are closed and are taken in the positive direction in the complex plane, all 
enclosing the support of F y,H . 

When ElXijl 4 — 1 — k = X + o(l) uniformly in i, j and T is a diagonal matrix with 
positive eigenvalues, then we have 
1 p 



V 



3=1 



33 



J 33 



zHdH(t) 



[t-z{l + yzs{z))f 



and 



1 

P 



: L Jjj L 



h{z u Z2) = fix 



33 



z\z 2 dH{t) 



[t - zi(l + yzis{zx))][t - z 2 (l + yz 2 s{z 2 ))\ ' 



Then the mean (14.161) has the additional term 

/3 X ■ yz(l + yzs(z)) 3 



tdH(t) 



r (l+yzs(z)) 2 dH(t) \ J [t - z(l + yZs(z)W 
y J (t/z-l-yzs(z)) 2 I 



(t/z-l-yzs(z)) 2 J 

and the covariance (14.91) has the additional term 

d 2 f z l (l + yz 1 s(z 1 ))z 2 (l + yz2s(z 2 )) 



dz\dz 2 



[t - 2i(l + yz\s{z\))][t - z 2 (l + yz 2 s(z 2 ))} 



dH{t) 



Then Proposition 12.11 easily extends to the following proposition. 



Proposition 2.2 Let assumptions of Proposition{KT\hold. Moreover, assume that E\Xij\ A — 
1 — « = x +o(l) uniformly in i,j and T is a diagonal matrix with positive eigenvalues, then 



we obtain that [X n (fi), ■ ■ 
with mean function 



K 



2ni 



X n (fk)] weakly converges to a Gaussian vector [Xf 1} ■ ■ ■ ,Xf h ] 

t(l+yzs(z)) 3 dH(t) 



vS 



it I z—l—yzs(z))' i 



yj 



2m 

and covariance function 



(t/z-l-yzs(z)) 2 

yz(l + yzs(z)) 3 



2 dz . 



) 2 c 
-yzs(z)) 2 



tdH{t) 



r (l+yzs{z)) 2 dH(t) J [t - Z (l + VZsfzW 
yj (t/z~l-yzs(z)) 2 J 1 



dz 



Cov(X fi ,X fj ) 

f (Zi)f (z 2 ) ■ Q[gl(l±Mil(gi))] 9[z 2 (l+yz 2 s(z 2 ))] 



H 



47T 2 

'An 2 



dz\ 



dz 2 



dz\dz 2 



\zxil + yz 1 s(z 1 )) - z 2 (l + yz 2 s(z 2 ))] 2 

d 2 T f z 1 (l + yz 1 s(z 1 ))z 2 (l + yz 2 s(z 2 ))dH(t) 



fi(zi)fj(z 2 ) 



dz\dz 2 



V 



[t - zi(l + yzis(zi))][t - z 2 {\ + yz 2 s{z 2 ))] 
The contours in \2. 7| ) and $2.8\) are closed and are taken in the positive direction in the 
complex plane, all enclosing the support of F y ' H . 



dz\dz 2 . 



2.1 Relati on between Theorem [272] and the CLT in lBai and Silverstein 



( 120041 ) 



Theorem 12.21 can be viewed a complemet to the CLT in iBai and Silverstein! (J2004J) while 
moving from the sample covariance matrix S to its inverse S -1 . When the factor T in 
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S T is not invertible, these CLT's are not directly comparable. If T is indeed invertible, 
these CLT's should be comparable. In this subsection, we will prove that they are indeed 
the same in this case. More precisely we prove that the mean and c ovariance functions 
given in Theorem 12.21 are the same as those given in Theorem 1.1 of 
J200J. 

Actually, when T is invertible, we have 



Bai and Silverstein 



S n {z) 



p 
1 



5 VA, 



-E 

pz 



i=i 



ST- 1 ) - z 

^(ST- 1 ) 
XAST- 1 ) - i 



p ^ A . ((ST -i)-i) - 

1 A_ AifST -1 ) 
1 



V 



1=1 



^A, : ST- 1 



1 
1 



z 2 p 



4-? AifST- 1 : 



i=i 



Z Z A z 



1 ,1. 

771, 

m„ f — 



2 2' 
1 

yz 



2 \ „,— " 



9 ^Jin V / ' 



where m n is the Stieltjes transform of X n T X X* with X* = (xi 

1 + yzs(z) = 1 



s\z 



1 

yz 



1 ^ 

yz A z 



1 1 r 1 ^ 
1 rri( — J 

z z 



x n ) is p x n. That is, 
(2.9) 



■—ml — ) 

z z 



where s(z) is the limit of s n (z) andm(z) is the limit of m n (z). So the CLT of p(s n (z)— s(z)) 



is the same as — \ ■ n(m n { 
know that the CLT of 

has mean 



— m 



-)). By Lemma 1.1 of Bai and Silverstein (2004), we 



~ ■ n(m n (-) - m n (-)) 



z z 

t-(m(l/z)) 3 d(H(t)) 



(t+m(l/«))3 



zZ [i-vj 



(t+m(l/z)) 2 J 



and covariance 



\ 21 ' \ 29 



22 ' 



44 imli-) -mij;)) 2 (zi 



Z2 
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It is easily to verify that 



r Hm{l/z)fd{H{t)) r t-z*{l+ys(z)fdH(t) r t-(l+ys(z)) s dH(t) 

ilJ (t+m(l/z)) 3 J- yJ (t-z(l+yzs(z))) s 1 f J (t/ 'z-l-yzs(z)) 3 



7-2 r-| ,. r (rn(l/z))2d(H(t)) ]2 z 2 r, r z\l+yzs{z))^dH{t) ]2 ,2 r, r (l+yzs(z))*dH(t) ]2 ' 

I 1 f J (t+m(l/ Z )) 2 J L A i/J (t-,z(l+yzs(.2))) 2 J I 1 yJ (t/z-l-yzs(z)) 2 J 

and 

i g^Mj) _ i = [2 1 (i+^ lg (^ 1 ))rh(i+^ 2g (^ 2 ))r _ i 

44 imi-k) -mi^)) 2 {z 1 -z 2 ) 2 [z^l +yz 1 s{z 1 )) - z 2 {\ + VZ2s(z 2 ))} 2 {zi-z 2 ) 2 ' 

which are the same as given in Theorem 12.21 Thus, when T is inversible, the CLT of LSS 
of S _1 T has the same mean and covariance functions as that obtained by Theorem 1.1 of 
Bai and Silverstein (2004). 



3 Proof of Theorem 2.1 



Using exactly the same approach employed in Section 4.3 of Bai and Silverstein (2010), we 
may truncate the extreme eigenvalues of T and tails of the random variables Xy and then 
renormalize them without altering the LSD of S _1 T. So we may assume that Assumption 
2* is true and \xij\ < r] n y/n where r] n — > 0. 

Now, we proceed with the proof of Theorem 12.11 To start with, we assume that T is 
invertible and there is a positive constant uj > such that H(l>j) = 0, that is, the norm of 
T _1 is bounded. By Theorem 4.1 of Bai and Silverstein (2010) we know that the LSD of 
ST -1 exists and its Stieltjes transform m(z) satisfies 

m(z) = [ — l — - dH(l/t) = [ tdH{t ] . . (3.1) 

v; J t (l-y-yzm(z))-z yi> J 1 - y - yzm(z) - tz v ; 

Note that m(z) is the unique solution to the equation (13. ip that has the same sign of 
imaginary part as z. 

If we denote the Stieltjes transforms of S _1 T and ST -1 by s n (z) and m n (z), respectively. 
By the relation 

m n {z) = -s n (l/z), 

z z z 

and m n (z) —> m(z) a.s., we know that with probability 1, s n (z) converges to a limit s(z) 
that satisfies 

1 1 , . . f tdH(t) , . 
-s l z = / —. — v ; - , „ . 3.2 

Z Z 2 K 1 > J l-y-y Z {-\-^s{l/z))-tz 1 ' 

Changing z as 1/z and simplifying it, we obtain (12. 6p . 
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Now, we consider possibly singular T and will show that for any fixed z = u + iv with 
v > 0, s n (z) still converges to a limit s(z) that satisfies (12. 6p . 

For any fixed e > 0, define T £ = T+el and define S + from S by replacing its eigenvalues 
less than where a = (1 — yfy) 2 ■ By the rank inequality of Bai (1999), we have 



F a ~ lT - F S +' T 



< - * { XAS) < -a J> ->■ 0,a.s. 
V 



By Theorem A. 45 of Bai and Silverstein (2010), 



L(F 



< HSiVT-TUII < 2a- 1 e. 



Using again the rank inequality, we have 



F s 1Te — F s + lTe 



< l ~ # |a,(S) < ^aj ->0,a. 



(3.3) 



(3.4) 



(3.5) 



By what has been proved anove for invertible T, with probability 1, s n>e (z) = -tr(S 1 T £ ) — >■ 
s e (z) which is a solution to the equation 

zs £ (z) = -1 - 



tdH £ (t) 



1 — z — yz 2 s e (z) + t 



(3.6) 



where # e (t) = H(t-e). 

To complete the proof of the theorem, we only need to verify that the equation (13. 6p 
has a unique solution that is the Stieltjes transform of a probability distribution, and the 
solution s e (z) is right-continuous at e — 0. Making a transformation w e (z) = s/z(l+zs E (z), 
where y/z is the square root of z satisfying Q(z)^s(y/z) > 0, then the equation (13.61) becomes 



w £ (z) 



tdH £ {t) 



^-(l-y)y/z-yw e {zy 



(3.7) 



where w e (z) has the same sign of imaginary part as z. 

We only need to consider the case where ^s(z) > 0. Let W2 = $f(w e (z)) > 0, comparing 
the imaginary parts of ( 13. Tj) . we have 



U>2 



\*\ 



+ (1 - y)3(\/x) + yw 2 

—dH £ (t) 



> 



m-(l-y)^-y We ( Z ) 

yw2 



^ - (1 -y)Vz-yw E (z) 



dH £ (t), 
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which implies that 



ydH e (t) 



^-(l-y)^-yw £ (z) 



< 1. 



(3.8) 



Suppose (13.71) had two solution with = ^s(w^) > 0, j = 1,2. Then making 
difference of both sides and cancelling w\ — w<i from both sides, we obtain 



l = y 



tdH £ (t) 



i+t 



i+t 



• y /z—(l—y)^/z—yw < - 1 ') 1 V y r z-(l-y)y r z-yw ( ?'> ■ 

which implies by Cauchy-Schwarz that 



1 < 




1/2 



ydH £ (t) 



m-(l-y)^-y W V 



ydH e (t) 



< 1, 



7 



where the last inequality follows by applying (13. 8 p for both and w^ 2 \ The contradiction 
proves the uniqueness of a solution to (13.71) . 

Finally, we show that the solution w e is right-continuous at £ = 0. By (13. 7p , we have 



wAz) - w {z 



td{H £ (t)-H{t)) 
±±£-(l-y)^-yw e (z) 



tdH(t) 



(3.9) 



Since 



1 + t 



(1 - y)^fz-yw e {z) 



.1 + t 



we have 



> - (1 - y) - 2/w e (z)) > (1 - 2/)9f(v^) 



*dif(t) 



< 



V 



v 1/2 



tdH(t) 



7= - (i -y)Vz-ywo(z) 



< i. 



/ 



It follows that w £ (2) — wo (2) —7- which implies that s e (z) — s(z) — >■ 0. 
The proof of Theorem 12.11 is complete. 
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4 Proof of Theorem 



2.2 



We fir st describe the strategy of t he proof that follows the proof in iBai and Silverstein 



( 2004 ) and an improved version in IBai and Silverstein ( 2010 ). First, due to Assumption 



1*, we may truncate the random variables Xij at r] n y/n and renormalize them without 
alerting the CLT of X n (f), where t] n I with some slow rate. Therefore, we may make 
the following additional assumptions: 

1. \'Xij\ < T] n y/n; 

2. Ex 2 - = K-l + oin" 1 ); 

3. E|zJ.| = 1 + k + o(1). 



Define a contour C n by 



c n = d u c u u c 6 u c r 



where 

C« = {x + ivq : x e [xi,x u ]}, C b = {x - iu : x G [x*,x u ]}, 
= {x« + iv : \v\ < v }, C r = {x r + iu : \v\ < z/ } 

and (xi, x r ) D [liminf A min (T)/(l + ^/y) 2 , limsup A max (T)/(l — y^) 2 ] and is enclosed in the 
analytic region of the /j(x)'s. Following Bai and Silverstein (2004), we can rewrite X n (f) 
as 

Mf) = ~ i f(z)p(s n (z) - s° n (z))dz, (4.1) 
2n Jc n 

where s° n (z) is the Stieltjes transform of F Vn,Hn . 

Remark 4.1 Note that the identity (f^.i| ) holds only when all eigenvalues of S _1 T are 
falling inside the interval (x;,x r ). Bai and Yin (1993), with probability 1, when n is 
large, all eigenvalues of S are falling inside the interval ((1 — ^fy) 2 ~ £ i (1 + Vv) 2 + £ ) 



which confirms that (4-1) holds for all large n. So, without loss of generality, in the proof 



of Theorem \2.2i we assume U^W holds 



Write M n (z) = p(s n (z) - s° n {z)) = M*(z) + M 2 {z), where M*(z) = p{s n {z) - Es n (z)) 
and M 2 (z) = p(Es n (z) - s° n (z)). We shall establish a CLT for M*(z), and then find the 
limit of M 2 (z) on C u and C&. Their combinaison will complete the proof of Theorem 12.21 
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4.1 Finite-dimensional convergence of M^(z) on C u 
We first prove an auxiliary theorem. 

Theorem 4.1 Under Assumptions 1* , 2*, and 3, M*(z) converges weakly to a complex 
Gaussian process Mi(-) on the contour z e C, with mean function 

EMt(z) = 

and covariance function 
Cov(MiOi),Mi(z 2 )) = k 



[z 1 (l + yz 1 s(z 1 ))}'[z 2 {l + yz 2 s(z 2 ))}' 1 
[zi(l + yztsizt)) - z 2 (l + yz 2 s(z 2 ))] 2 {z l - z 2 ) 2 _ 



(4.2) 



Proof. Let Ej denote the conditional expectation given {x 1; • ■ ■ , x^} and E denote the 
unconditional expectation. Denote z = u + iv with v > fixed, 

a t = ^X,, S fc = S - a k cc%, D = S - zl, D fc = T - ^S fc , 

= l-a^lT-SiJ-iQi' W) = l-itrClT-SO- 1 ' 

Then we have 

A(z)" 1 = A(z)" 1 - 7i (z), Pi(z)Pi\z) = 1 - /9i(z)7i(4 
Therefore, by Taylor expansion 

(Ei-Ei-Olog^ 1 ^) 
= (Ei - Ei_i) (log/Jr 1 ^) - log^C*)) 
= (Ej - E J _ 1 )[-A(^)7 i (^) + P?(z, OiWiiz)] 
= -Ei/3i(z)ji(z) + (E, - Ej_i)/3j 2 (2, 0i>7?(*)- 



(4.3) 



Here, we have used a formula that log/3^ 1 — log/3" 1 = log j3i(z)(3^ . In fact we should add 
an additional term 27ik(z) where k{z) is a random integer function of z. This term does 
make any contribution because we only need the derivative of the function log/3" 1 in the 
next step. 
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For any i < n, we have 



s„\z\ 



^(S^T - ^I)" 1 = ±trS(T - ^S)^ 1 
itr(Si + «i«D(T - zSi - za^)- 1 

Mr(^ + za t°Q ((T - ^S,)- 1 + ^iS^g^ 
-Atr(T - zS, - - T) ((T - .S,)- 1 + ^S^g^ 

+ l^apr'c, ~~ l-raJDr^ ~ za i U i a V 



2 "T pz i "T p l-^D" 1 ^ 

p cte 



-1 + J-trTD^ + ^logA^) 



pz 



Therefore, 

s„(z) - Es n (z) 

Since 



~-A E(Ei - Ej_i) log(l - sap^a. 



i=i 

re 



E EiftCstfito - E(E, - E^O^Cz, 
i=i i=i 



z . 



8=1 



E # | (Ej-i - Ei)^ 2 (2;, 0i)7? 



8=1 



< ±Y.e\0&zAWM\ 

i=l 
n 

< 4E^l7,W| 4 

i=l 

= nO(n~ l 7]n) = o(l) (by Lemma [4. ip 



(4.4) 



we have 

p((s n (^) - Es n (z)) = 
where 

We first consider a finite sum 



7 J « 

S E iTz Hzmz) + 0,(1) = - T + < l ) 



i=i 



8=1 



= E^(^) 7 i(z). 



r n 



n r 



fe=l i=l i=l fc=l 

from r points on the contour with arbitrary weighting numbers a*.. That is, we need to 
complete the following two steps: 
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Step 1: Verify the Lyapunoff condition, i.e. E E | 4 = o(l). 



i=i 



In fact, if z G C M or C&, by the fact that |A(^)| < M/Vo, 

n n 

^E|y,(z)| 4 < C^E|7,(z)| 4 



i=l 



i=l 



< CrT^E (tr(Dri(,)Dri( 2 -))) 2 + maxE|x^|[Dri] J ,| 

i=i L lJ i=i 

< C^n" 1 + »£)-► 0, 

where [D,^ 1 ]^- is the j-th diagonal entry of D~ (z) which is bounded by \z\/u . 

n n _ _ 

Step 2: Find the limits of E E^y^i)*^) = 9^ E E^E^zi^zO-E^^)^)]. 



t=i 



^J^flfcVi^fc) 



i=l fc=l 



i=l 



^a fc Fi(z fc ) 



fc=i 



=1 fe=i 



because E \Yi(z k )\ 2 = 0(n x ) by Lemma H~T1 We have 

Pi(z)-bi(z) = A(z)6 i (z)(^ 1 tr(iT-S J )- 1 -n- 1 Etr(iT-S l )- 1 ) 



where bAz] 



l-n- 1 Etr(iT-S i ) 



— . Then (Bai and Silverstein (2010), P139) 



E\Uz)-h{z)\ 21 < ^E(^ 1 tr(iT-S l )' 1 -^ 1 Etr(iT-S J )- 1 ) 



2/ 



2/ 



KE U £ [E i tr(jT - SO^ 1 - E^trgT - S^ 1 ] 



J'=2 



2/ 



U E (Ej - E,_!)tr (IT - 1 - (±T - Sy)" 1 



i=2 



2i 



a'(±T-S lf )-% 



n 



< #rE E (Ei-E^i) 



i=2 



l+a'^T-Si,)-^ 



< 



(Lemma 2.12 of Bai and Silverstein (2010)) 
K 



Then E\(3i(z) — bi(z) \ 21 = 0(n l ) is uniformly. Then 

n n 

Ej_i[E^j (zi^iizi) ■ Eij3i(z 2 )7i(z2)] - >^ b i (z 1 )bi(z2)Ei- 1 [E i ji(z 1 ) ■ Eiji(z 2 )} = o p (l) 



i=l 



i=l 
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Then we only consider the limit of 

n 

J2bi(z 1 )b i (z 2 )E i _ 1 [E i ' : f i (z 1 )E i %(z2)} 



■i=i 



i=l 



Eif^-T — Si) -1 Ei(iT — S< 



(4.5) 



[by (1.15) of Bai and Silverstein (2004)]. 



We have 



-T - Si) - -T + bi(z)I = -J2 + ^.(z)!. 

k^i 



z z n * — ' n 

Multiplying by (£=±bi(z)I - ^T)" 1 on the left, (±T - Si)' 1 on the right, then we have 



-T-S,)- 1 



^6^)1 - -T)- 1 

n z 



n z z 



+ 



kj^i 

n — 1 . , w n — 1 



where 



- hl {z)(-^h{z)l - -T)-\-T - S,)" 1 

n n z z 

n — 1 1 

' 6,(3)1 - -T)" 1 - k{z)A{z) - B(z) - C(z) 

n z 



A w = E ( — M*) 1 - - T ) («*«* - - J )(- T - S ^) _1 

^ \ n z n z 

k^i x 

B(z) = J2(M Z ) ~ bi{z)) ("-^b^z)! - *t) a fc a£(*T - S.^ 1 

k^i 



n 



n 



-bi^)( rL ^ L b i (z)l--T) 

k^i 



71 



-1 



Similarly, we have 

n — 1 , , w 1 „, 
bj(z)l T 

n z 

where if is a constant. Similarly, we have 



T-s^rM-T-s.r 1 



< K 



\bik{z) - bi{z)\ 



bi(z)bik{z) 



-Etr(-T - S,)- 1 - -Etr(-T - S^)" 1 

n z n z 



1 

n 



1. 



b ik (z)bi(z)E/3 k(i) (z)cxl(-T - S ik ) 2 a k 

z 



(4.6) 



Oin- 1 ) (4.7) 
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and 



where 



E(&(o(*) - hk(z)) 2 = Oin- 1 ) by Lemma O 

1 



(4.8) 



h{z) 



Pk(i){z) 
1 



1 - a' fc (i T " S^-^fe 



1 - lEtr(±T - S 



— , &*(*) = 

'/ n 



1 



Etr(iT - S^y 1 



First we have 



E 



trEiB^r^J-T - S,)" 1 



< EE EitrCS^-)^) - 6 i (af 1 ))(^6 i (* l )I - j-TyW^Kj-T - S lk )~\j-T - 



-i(_L 



21 > n K\z% 

T - Si)- 1 ^ 



< EE Eitfwiz) - bi(z))al(±T - S lk ) 

< E v 1/2 \Wm(z) - Hz)Y\ ■ e 1/2 cxi^T - s^-^t - s,)- 1 ^ 

= ^E 1 / 2 a*(±T - S^-^^T - Si)- 1 ^ (by (1.15) of Bai and Silverstein (2004)) 
where Sj is the analogue for the matrix Sj with vectors x J+1 , • • • ,x n replaced by their iid 



copies x, + i 



Second we have 

I £ E trEiC(zi) • E,(^T - S,)" 1 

k^i 



< A EE 

= 1 E E 

< A EE 

k^i 



tvEAiz^bjiz)! - iT)- 1 f (IT - S^)" 1 - (IT - S^J (±T - S,)" 1 
EMzX^bjiz)! - \T)-^ km > h {±T - S lk )-\j-T - S^ij-T - S ik )-'cx k 
a' t (±T - S lfe )- 1 (I-T - §<) _1 (^T - Si,)" 1 ", 



(by (1.15) of Bai and Silverstein (2004)) 
< K 
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Third, we consider 

fti^OtrEiA^OEiC^T-Si)- 1 
= btMtr £ (^(zjl - ±T)-i(a k cxt - ±I)E,(±T - S^E^T - S,)- 1 



k<i 1 



-T-S i )' 1 -(-T-S lfc )- 1 

'^2 ^2 



n — 1 1 

( 6 i (z 1 )I--T)- 1 a* 



-6*(zi)tri Y7— 6^)1 - -T)- x Ei(-T - S^^M-T - S,)" 1 - (-T - S^)" 1 
n £ — n Z\ Z\ Z2 Z2 



where 
E|C 2 | 



E|C 3 



^2 

&i(*i)tr V7— &i(zi)I - -T^Ka* - h)rEi(-T - S^E^-T - S. lk 
n Z\ n Z\ z 2 



C 3 



h{zx)txl £(2=16^)1 - J-T^E^T - S^-V^K^T - S,)" 1 - (£T - S^)" 1 



k<i 



1 ^ ( 1 

k<i 

< K (similar to the proof of (??)) 



E 



^i)trE(^(^i)I 

k<i 



1 T^Kc** - JI)E,(±T - S^E^T - S^)" 1 



T - - JtrE^T - SaJ-^T - S, 



aJE^T - S^-^^T - S^ 1 ^ - ±trE,(^T - S, 



//J 



-1/ 1 



ik) 



T-S^)" 1 



k<i 

= O(ns) (by (1.15) of Bai and Silverstein (2004)) 

E «fcE,(^T - S ifc )" 1 E,[(^T - S,)" 1 - (iT - S^r 1 ]^^) 1 " ^T)" 1 ^ 

6i(^i)6i(^) E EiOfcC^T - S 4fc )" 1 (^T - S^a* 

■a* k (j-T - S ik )-\B=k bi ( Zl )l _ i-T) _1 o; fc + O p (nV2) (by and g^) 
^M^OW E Eitr(^T - Sik)- 1 ^ - S^y 1 

k<i 

^hiz^h^EMj-J - s *) -1 (i T - s,)" 1 

-tr(±T - S t )-\^k( Zl )I - IT)- 1 + 0,(^/2) 
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That is, 



tr[E. t (i-T - SO^K^T - S^ 1 [l + U&bifaMzi) ■ tr(±-T - S z ) 



-tr 



-l/n—l 



1 rp\-l 



(^(zr)I - J-T)- 1 • E^T - Sr 1 + OM 12 )- 



Then by (14. 6[) we have 



trfE^T-S.r^T-S.r 1 
1 - ^(^)^ 2 )tr(^( 2l )I - ^T)" 1 • (2=^)1 - iT)- 1 
= tr [{^k(z x )I - t^T) -1 • (2=1^(^)1 - j-jy] + O p (nW) 

because tiA(z 1 )(^b i {z 1 )I - j-T)' 1 = O p (n 1 ' 2 ), trB(^)( 2^6*^)1 - ^T)" 1 = O^n 1 ^) 
and trCOziX^&iCzOl - ^T)" 1 = O p {n 1 / 2 ). 
By Lemma 14.11 and 14. 2[ we have 

IM*) - b{z)\ < Kn~\ \bi(z) - EPi(z)\ < KrC 1 ' 2 , 
1 " 

— E (-! + = Es„(z), |Es n (*) - s° (*)| < i^n" 1 

£$(2) = y n zEs n (z) + 1 



So we have 



trp^iT-S.n^T-S;)- 1 

(i-i) 



1 - 



6(^i)6(^)tr(6(zi)I - 



1 mWl 



1 m\_l 



tr 



6(^i)I 



1 T>\-1 



(b(z 2 )I 



1 rp\-l 



So we obtain 



6(c,)Kz 2 )tr[E,(J 7 T - S,)-'](iT - Si)" 1 



Pj (t( „ ) -m-JL., -«.W+0,(~^) 



(i-1) 



n Vn f 



b(z 1 )b(z 2 ) 
(6(»)- it). (6(a)- it) 



That is, 



6(^i)K^)tr[E i (-T - SO^K-T - S^ 1 

#1 ^2 



l - 



(*-i) 



2/n/ 



b(zi)b(z 2 ) 

(6(*i)-=-*)-(6(«a)-^t) 
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Moreover, we have 



n2 1 S>0 K * 6*0 J l- x . v f , dH(t) 

1 0(21,33) 



a(zi,z 2 ) / 7 rdx = / dz 



where 



(1 + yz 1 s(zi)) ■ (1 + yz 2 s{z 2 )) 
- 1 - yzia(zi)) ■ - 1 - 2/^2)) 



d#(f) 



m(— ) • m(— ) 



f* , &-k\ ft , ^) 

m( — ) ■ m(— ) 

m.{^)-m{^) ( f 1 



rr-H / ; 1 ~,i, dH(t)- / - ■ „ (1 . dH{t) 



m(— ) • m(— ) / 1 1 

J _|_ V 2i y V 22 7 



with m(-) = + yzs(z)) and 



-(l+2/zs(z)) 

_ 1 ( 1 1 L_ 

l+2/zs(z) ( U m(-) 



(by (525}). 



That is, the covariance is 



0(21,22) 

<9 2 /• 1 , d 

-dz 



( da(z 1 ,z 2 )/dz 1 \ 
da\da 2 J 1 — z dz 2 \ 1 — 0(21,22) / 
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So we obtain 

da(zx, z 2 )/dz 1 
1 - a(zi, z 2 ) 



(£(.!)- m(JL))a \ Zl 

(m(£))'m(±) 



1 \ fh(-) ■ m(— 

J_ \ _|_ ' V Z2 



-2 



> ^2 ' 



ml 



ml 



m (±) m (±) (1.-1. 



Z2 ' V Zl 



=2 



■22 ' 



m(i)(m(i)-m(^)) lfa-lfa 



and 



9 / , da(z 1 ,z 2 )/dz 1 \ 
dz 2 \ 1 - a(zi,2 2 ) / 



(™(i)-™(^)) 2 ^(iM-i/ft) 2 

(m(i))'(m(i))' 1 



(™(i)-™(^)) 2 (^-^) 2 

+ yzis^i))]'^! + 2/z 2 s(z 2 ))]' 1 

[zi(l + yz 1 s(z 1 )) - z 2 (l + yz 2 s(z 2 ))} 2 (z% - z 2 ) 2 ' 



That is, by (14. 5 j) we have 



Cov(M(, 1 ), M(, 2 )) = k f Ml + ^^i))]l^(l + ^ 2g (^))r _ 1 

1 1 ; 1 Vh(i + ^^(^i))-^(i + ^(^ 2 ))] 2 ( Zl -z 2 y 

Then the proof of Theorem 14.11 is completed. 



(4.9) 



4.2 Tightness of M*(z) 

Theorem 4.2 Under Assumptions T , 2* and 3, the sequence of random functions M^(z) 
is tight for z G C U C. 



22 



Proof. We want to show that 

blip . . ^ 

n;zi,z 2 eC n \ Z 1 ~ Z 2\ 

is finite. It is straightforward to verify that this will be true if we can find a K > for 
which 

n;2i,2 2 eC„ \Zl — Z 2 \ 

Af^(zi) - Af*(z 2 ) = p(s n (*i) - s re (z 2 )) - p • E(s n (zi) - s n (z 2 )) 

s n { Zl ) - s n (z 2 ) = -tr [(S- l T - zjy 1 - (S^T - = -(^ - ^trD"^^ 1 ^) 

p P 

where D(» = (S^T - zl)" 1 . We have 

M*(zi) - AfiQza) = s n (zi) - s w (z 2 ) - E(s ra (zi) - s n {z 2 )) 

Z\ — Z 2 Z\ — z 2 

n 

= ^2(E i -E i . 1 )tTD- 1 (z 1 )B- 1 (z 2 ) 

i=l 
n 

t=i 

and 

(S^T-zI)- 1 = S(T-zS)- 1 

= S(T - zSi - zctiOt'i)- 1 



(S< + (d: 

1 * l-z-a D, 1 a i 1-2-a D, 1 a i 



fS~ 1 T — Zl) _1 + Z ' SiT>i laiOL 'i D i 1 _L a '°. D 1 

(s^t - ziy 1 + {z - s ^ +*y D - 



where S^D" 1 = (S^T - zl)" 1 . That is, 

(S^T - ziy 1 - (S^T - .I)- 1 = (z ^ iDrl + y D ' 71 = (ZS.D- 1 + Ticuctp^Mz). 

1 — z ■ <xD, OLj 
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trtS^T - ^-^S^T - z 2 \)~ l - tr(S^T - zJ^-^S^T - z 2 \y l 
= trKS^T - z 1 iy 1 - (Sr*T - ^-^[(S^T - z.iy 1 - (S^T - ^I)" 1 ] 

+tr[(S- 1 T - ^I)- 1 - (S^T - z 1 iy l ](S; 1 T - z 2 iy l 

+tr(Sr 1 T - Zil^KS^T - z 2 l)~ l - (S^T - ^I)" 1 ] 
= a'pr^z^B- 1 + I)ct t • oJDr^^SiDr 1 + I)a 4 ■ A(zi)A(z 2 ) 
• ap^S^T - ^^(^iS.D- 1 + I) ai 

+/3i(z 2 ) ■ aJDr^Sr'T - 2iI)- 1 (^S i Dr 1 + I)a 4 
= (ap^S^TFr^^a,) 2 • + A(*i) • aP^F^^S^TFr 1 ^)^ 

+fr(z 2 ) ■ a'pr^iz^TF^iz^ 

where Fr 1 ^) = (S^T - ziy 1 and (S^T - ziy 1 = -±I + ^T^T - zT)~\ 



M^ Zl )-M^z 2 )_ = ^ (E ._ E ._ i)tr(s -i x _^ iI) -i (s -i T _ ; , 2l) - 1 (410) 

i=i 
?! 

= ^(E.-E^Cap^S^TFr^^aO'-A^OA^) (4.11) 
i=i 

+ ^(E, - Ei-OACzO • a'p- 1 F- 1 (z 2 )S. 1 TFr\z 1 )(x i (4.12) 

i=i 

n 

+ ^(E, - Ei-OftC^) ■ ap- 1 F- 1 (z 1 )Sr 1 TF- 1 (z 2 )a i (4.13) 

i=l 

Our goal is to show that the absolute second moment of (14.101) is bounded. We begin with 
( BHD - We have 

n 

E(E, - E^OACzO • ap^Fr^S^TFr 1 ^ 

i=l 
n 

= £(E, - EV-i)6,(«i) • apr^^S^TFr 1 ^)^ 

i=l 

n 

- E(Ei - Ei_i)/3j(zi)6i(zi)ei(zi) ■ a^Fr^S^TFr 1 ^)^ 

i=i 

= W^-WJj 

where £i (z) = a'^T - S,)" 1 ^ - ^Etr(±T - S;)- 1 and 

n 

E|^i| 2 = E|E(E J -^-i)6,(^i)-«p- 1 F- 1 (z 2 )Sr 1 TFr 1 (z 1 )a i | 2 

8=1 

n 

= £ EKE, - ^_,)^( 2| ) • ap^Fr^S^TFr^iHI 2 

i=l 
n 

= £ ^(zOElEialDr^^S^TFr 1 ^)^ - itrD^Pr'^Sr'TPr 1 ^)! 2 

i=l 

< K 
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by Lemma 14.21 Moreover, we have 



E\W 2 \ 2 = EE|(E i -E i _ 1 )A(^i)& i (^i)£i(^)-^D- 1 Fr 1 (^)Sr 1 TFr 1 (^)a i 



i=i 



where 



and 



= nE|(Ei - Ei^BiiziMz^Siizy) ■ op: ^(^S^TF^)^ 
< 2nb*( Zl ) ■ E/3?(zi)ef(zi) ■ (a' i D- 1 F^(z 2 )Si 1 TF^(z 1 )<x i ) 2 < K 

\Pi( z )\ = |i - aj(iT - so-^i < i + i^OiSr^Tsr 1 - zi)- 1 ^! 

< l + |z| -laiHlSr^TSr 1 -^)- 1 !! 

< l + ^la^ + n^dlSiH > 77 r orA^ in < 77j) 

ojD^FrH^Sr'TFr 1 ^)^ < K|a,| 2 + n*/(||S,|| > ^orA^ < ij,). 



Similarly, it can be obtained that the second moment of (14.131) is uniformly finite. Now we 
begin (14.111) . We have 



^(E, - E i _ 1 )(a' i D^Sr 1 TFr\z 2 )c t {) 2 ■ ft^)/^) 



n 



i=i 



ajDr'sr'TFr 1 ^)^ 



-trpr^TF^) 



n 



h{zi)bi(z 2 ) 



- J^(E, - ^(a^S^TF" 1 ^)^) 2 • A(^i)A(^)^(^)^(^ 2 ) 

i=l 

- ^(E, - E i _ 1 )(« , i D7 1 Sr 1 TFr 1 (^)a i ) 2 • b^b^^e^) 

i=l 

= Zi — z 2 — z 3 . 

By similar methods to W2, we obtain that the second moments of Z 2 and Z3 are uniformly 
finite. Now we begin Z\. We have 

El^l 2 

n 



i=i 

n 

j=i 
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trp-S^TF-^)) 



aiD^S^TFr 1 ^)**, - -trCD^S^TFr 1 ^)) 



n 



--£e fap^S^TFr^^)^ - itrp-^TFr 1 ^))) • iDr^TFr 1 ^)! 
n z — ' V n J 

i=i x ' 



< A. 
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Then sup ^KM-^W < K . 

n;zi,Z2GC + 

So the proof of Theorem 14.21 is completed. 



4.3 Uniform convergence of M%(z) = p(Es n (z) — s^(z)) for z G 
Theorem 4.3 We have 



sup 

Z&Cn 



m:(z) 



i 



f t(l+yzs(z)fdH{i) 
» J (t/z-l-yzs(z)) :i 



Z 2 ( 1 r {l+yzs{z))UH(t) \ 

\ L y J {t/z~l-yzs(z)y J 

where M%(z) converges uniformly to the limit 



— > as n —>• +oo 



2/ J (tA-l-^W) 3 _ 1 °H y J {t/z-X-yzs{z)Y ) 



(->_,. f (l+yzs(z))*dH{t) \ 
\ L y J (t/z-l-yzs(z))Z J 



Proof. We have 



and 



SnXZ) 



-tr(S _1 T - zl)- 1 
V 



1 " o^T - S,)- 1 ^ 

P Z^ l-a^iT-S,;)" 1 ^; 



z z A p 



i_ i_ iA_ 

-02 n -f-* 1 



-i 



By Lemma l4~4l we have s(z) = — - — \ ■ s(z) where 



S(z) 



l-yrh(z) 1-yJ -j \ dH(t)~ -l + y f^ d H(t) 



z l-yfh(z) 



is the limit of Hi (IT - S) \ s(z) is the limit of -tr (S - f ) 1 T and s 



-l 



y)z + ys(z). We have 



where 



Moreover, let 



Rr, 



+ y 



t + Es n (z) 
1 



dH n (t) 
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and 



z z 2 



where s° n (z) is the Stieltjes transform of F Vn ' n . So we obtain 

Es n {z)-s^{z) = -j— ff^ — ^ ^+Es n {z)s u n {z)R n 

{-i + vJ T^M dH n{t) - Rn) {-1 + yJ wm dH ^) 

That is, 

n(E~s n (z) - &(z)) = Eln(^) nRn 

H+v/ tr^M dH ^-^) I (-3+*/ T®M dH "W) 
p 1 (Vr?~ ( \, f JdHjfy_\ 1 y ( , f tdH n {t) 



Es re (z) 7 t + Es n (z)J Es n (z) z\ J t/z + Es n (z)/z 

It -sW!t + ^i)-^>i -£«*«»! 

2 I \z z J z ^-^ 



i=l 



So we obtain 



z 



-i 



-T-S 



: T-E/3,(z)I) T+(*T-Eft(z)l) f ^ a*^ - £&(*)t) Qt - T 



-T - Eft(*)1 1 T - E&(*) • ( -T - Eft(z)IJ ( -T - S 
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where ft (2) = 
by p, we get 



//T_ s ,s_i — • Taking expected values and trace on both sides and dividing 



I -T - S 
1. 



T-£ft(» ■ ^Etr0T-£ft(;z) ■ 1^ Q 
+-Etr^(-T-E/3 1 (2)-l) a^/^T-S^ Tft(*) 



-tr -T-E/3i(z)-I 
P 



T-S 



-i 



i=i 



P V- 2 



-tr -T - Eft (2) • I T - Eft (2) • -Etr -T - Eft (2) • I 



P 



-T-S 



-tr( -T-Eft(*) -I 

p V 2 



+—E/3 1 (z)a' 1 -T-Sx T( -T — Eft (2)1 ) ttl 



2 



-1 



1 



( 



1 



-1 



T + -Eft(2) 

Vn 

1. 



ai -T-Si T( -T — Eft (2)1 J a a 



Etr -T- Si) T -T- Eft (2)1 

n V 2 



-In 



+ 



2/ti 



— Eft (2) -Etr -T - Eft (2) ■ I 



-T-S 

z 



1 



1 



/1 



+— Eft (2) -Etr -T- Eft (z) ■ I -T - Si 



n 



-tr ( -T — Eft (2) ■ I T + —Eft (2) 
V \z J Vn 

-1 



-1 



al -T-Si T -T-Eft(z)I a, 



n \z 
(Eft(2)) 2 1 



1, 



T-Si T -T — Eft (2)1 



z 



Etr -T - S 



-T- Eft (z)l 

z 



-T-Si T + o(-) 
z J n 
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So we obtain 
-zEsJz) 



■ Rr, 



y 



tdH n (t) 



Es n (z) 



1 



tr -T - Eft(z) ■ I 



P V- 2 
— -Eft(z) 

Vn 



-Etrf -T-Si 

n \z 



-i 



P 



Etr -T-S 



-i 



-i 



1. 



a; -T-Si T -T — Eft(z)I a x 



-i 



I -T-Eft(z)I 



(EftW) 2 1 



Etr -T- Si T( -T — Eft(z)I 



o(i) 
n 



—eM{z) 

Vn 



-1 



ai -T-Si T( -T — Eft(z)I J ai 



1 



Etr -T - Si T -T - Eft (z)l 

n \z J \z 

(EftW) 2 



n 



■ E 



a, 



n 



1 



-Etr -T - Si T -T - Eft (z)I 



T-Si T -T — Eft(z)I ai 



1. 



(Eft(^)) 2 1 
y n 2 

y 



Etr -T-Si T -T-Eft(z)I 



-i 



o(i) 

77, 



■ E 



-1 



1 



ai -T-Si T -T — Eft ml «i 



-i 



-i 



T -T-Eft(^)I 



--Etrf -T- Si 

n \z 

+ (EftWl! E tr f i T - S 1 ) \ ( It - Eft (z)l) ~ 1 + o(-) (4.14) 
y • rr \2; J \z J n 

where ft = ft + 0] £j + ^ 2 fte 2 , e,- = a^T - S,-)" 1 ^ - ±£tr(±T - S,-)" 1 and ft(z) = 

l-i;m(z) ^ (n)' 

By (1.15) of Bai and Silverstein (2004) and QUID , when a11 

£1X6 complex 
= 0. (4.15) 
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In RSE case, 



E ln( 2 ) 2 . D 

y n 

~(E/M*)) 2 1 



EtrfiT-S^ T^T-E/^l) + (I] 



y 



+Eft(*) • EE^WofcaJCjT - S^^TE^) f (±T - - (±T - S lfc ) 

+E/3 1 (z) • EEJ 1 ^) (a fc a£ - £l) (JT - S^TE^) (±T - S lfc ) J + 
WiT-£/3i(*)l) T^i(z)I-iT^ RT-SiJ 



-i / \ -i 



^mr^T-^^l) T(W)I-iT) (jT-Sx) 



(Eft(z)) 

•)2 



«iEtr^T-£ft( 2 )lj T^E/^I-Jt) * 



where Ef 1 ^) = ^T-i^)^ , E^(z) = (e^z)!-^ and A(z) = E (V^)!" 
±t) (a k a% - ±I)(±T - S^)" 1 because 



•((iT-S 1 )- 1 -(iT-S lfc )- 1 ) = 0(4 



30 



and 



-i 



-2 



-1 



2/ 



(Eft(*)) 2 . y 

y 



■ I Etr(Eft(;z)I - iT)- 2 T( IT - E/^z)! 



(1— ym(z)) 2 n 
J ytdH(t) 



(l-ym(z)) 2 J (E/3 1 ( 2 )-4)2(i-E/3 1 (z)) 



y 



1 [l-ym(z)) 2 S (J3/8i(*)-*) a 
1 r ytdH(t) 

(l-ym(z))* ' J {t/z-l/{l-ym(zW 



dHCt) 



+ o(l) 



y 



{l-yk(z)Y ' / (t/z-l/(l-yrh( Z ))) 2 

r t{l+yzs{z)) 2 dH{t) 
if J {t/z-l~yzs(z)) 3 



dH{t) 



>(!) 



t _ ,. r (l+y* 8 (*)) 2 «iff(t) ' 

1 " J (t/z-l-J/Zs(z)) 2 

where Ep x {z) -> iz^py by (14261) . Thus by (jOSjl . (14221) and ( 1Q5l) . we have 
p(Es n (z) - = ^.j>(ES n (*)-a£(z)) 



-1 



« - 1 



n(E! n (z)-i£(z)) 



El„(^)l°(^ 



2// 



-dH n {t) 



^ l f(l+^s(2)) 3 rfg(t) 



(t/*-l-j/«s(*)) 3 



y r (l+^s(*))2rfif(t) V 



0(1) 



(t/z-l-j/zs(2)) 2 i 



So we conclude that in the RSE case 



sup 

z£C n 



M 2 n (z) - 



r t(l+yzs(z)fdH(i) 
K — 1 i/ J (t/z-l-yzs(z)) 3 



, r (l+yzs(z)) 2 dH(t) \ 

1 y J (t/z-l-yzs{z)) 2 J 



—7-0 asn-^ +oo. 
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By pill , we obtain 

r t(l+yzs(z)fdH{t) r t(-zf{l+yzs(z)fdH(t) 

EM(z) - K ~ - ~ ~ 



Z 2 /-, r (l+yzs(z))*dH(t) \ 2 Z 2 ( , r z 2 (l+yzs(z)) 2 dH(t) \ 2 

y- yJ (t/z-l-yzs(z)) 2 J \ L y J (t-z-yz 2 s(z)) 2 J 

That is, 

i dloe (l - v f (i+y«(')) 2 '*g(*A 
EM(z)- K ~ l g V yJ (*/-i-»»W)" J 



2 

So the proof of Theorem 14.31 is completed. 



4.4 Some Notations and Lemmas 

Lemma 4.1 (Bai and Silverstein (2010) P225) Suppose that x«, % = 1, • • • ,n are inde- 
pendent, with Exi = 0, E\xi\ 2 = 1, sup E\xi\ 4 = u < +oo and < r\ n ^Jn with rj n > 0. 
Assume that A is a complex matrix. Then, for any given 2 < i < 61og(n^ _1 ?7 4 ) and b > 1, 
we have 

E\a*Act - tr(A)\ l < im l (n77^)- 1 (406 2 ||Aj|?72) 1 
where a. — (x\, ■ ■ ■ , x n ) T . 

Lemma 4.2 (Bai and Silverstein (2010) P271) We have 

(m \ q 

nil*™ n^ B ^* - n ^ TB i) 
k=l J 1=1 

where m > 0, q > 0, ~f t = -j^T^X t , X t = (x t i, ■ ■ • ,x tp ) T , (x tj ,t = 1, ■ ■ ■ ,n,j = 1, • • • ,p) 
are independent with Extj = 0, E\xtj\ 2 = 1, sup E\xtj\ 4 — v< +oo and \xtj\ < rj n y/n with 
Vn > 0. 

Lemma 4.3 Under Assumptions 1-2, we obtain 

-tr( -T -S)- 1 ^ m(z), a.s. (4.17) 
p z 

where rh(z) is the unique solution to the equation m(z) = J t dH ^i - satisfying 

z l — ym(z) 

3f(z) ■ 3(m(z)) > 0. 



m q 

< Kn-^ A ^- 4)vo nii A ^!inn B ' 

k=l 1=1 
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Proof. For any real z < and complex w with ^s(w) > 0, by (4.1.2) of Page 61 of Bai and 
Silverstein (2010), we have 



W-T- 

p z 

—rh(z, w) 



S + wl) 



1 

V 
1 

w 

y 



-tr 



-T + S - wl) 



rdH (r) 



a.s. 



(4.18) 



1 + Tm(z, w) 

where m(z, w) is limit of the Stieltjes transform of the matrix + S, mn z is the Stieltjes 
transform of H z , the LSD of z^T, and Hq{t) = I( T >y)- By Theorem 5.11 and Lemma 2.14 
(Vitali Lemma) of Bai and Silverstein (2010), the convergence of ( I4.18P is also true for 
w = 0. That is, 



i tr( i T 

p z 



s)- 



1 



A 



m(z, 0) 
dH z (X) = 



1 



1 



ym(z, 0) 
— dH(X), a.s 



a.s. 



(4.19) 



l+yfh(z,0) 



l—ym(z,0) 

Denoting fh(z) = —m(z, 0), then the convergence of (14.171) is proved for all real nonpositive 
z. Noting that both sides of ( 14. 17ft are analytic functions of z on the region D~ = {z G C : 
z is not nonpositive real number}, applying Vitali Lemma again, we conclude that (I4.17P 
is true for all z G D~ and rh(z) satisfies 

Hz) = f \ 1 j dH{\) (4.20) 

J z l-yfh(z) 

Because the imaginary part of LHS of (I4.20p has the same sign as z, we conclude that 
5s(rh(z)) should have the same sign as $s(z). 

Our next goal is to show that for every non-real z, the equation (I4.20p has a unique 
solution m(z) whose imaginary part has the same sign as ^s(z). By symmetry, we only 
need to consider the case where ^s(z) > 0. Suppose that there are two different solutions 
mi(z) 7^ m 2 {z). Making difference of both sides of (I4.20p . we obtain 

v. 

-dH(X) 



1 



(l-ym 1 )(l~ym 2 ) 



(A i_y 

^2 \—ym\'\z 1— ym-2 ' 



< 



( 



\ 



1/2 



V 

|1— ym\ | 2 


- 2 dH{\) j - 


y 

\l—ym,2\ 2 


A 1 


A 1 


z 1—ymi 




z \—ym,2 



;dH(X) 



(4.21) 



Comparing the imaginary parts of both sides of (14.211) . we have 

2 

1,2. 



3(£)A 
\A 2 + 



l ^fdH(X), j 
i 

l-ymj 
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Since 5s(rrij) > implies that 



\l-ym,jp 



X 



z 1—ym.j 



rdH(\) < 1, 



which contradicts to (14.211) . 

The proof of the lemma is completed. 



Lemma 4.4 Under Assumptions 1, 2, 3, we have 



s(z) 



1 1 



2 • S \ Z 

z Z A 



where 



5{z) 



l-ym(z) 1-yJ 



^dH{t) ~ -i+ y jidH(ty 



t/z-(l-sm(z))- lu,IJ 2 1 yj t+s(z)' 

(1 — y)z + ys(z), s(z) is the Stieltjes transform of the LSD of S _1 T, and s(z) is 
the limit of Hi (S - f^T. 



s(z 



Proof. We have 
1 



/ T 

trfS^^-^I)- 1 = ---tr IS-- I T 

p z z A p \ z 



-1 



and 



1 " aJ(lT - S,)- 1 ^ 

Sn[Z) = — > - 
VZ *r~i 1 



i=l 



1 1 1 ^ 

yz yz n ^—^ 1 



a'fiT-S,-)- 1 ^ 



where an = -^X i; i = 1 • ■ • ,n. Let the limit of -tr (S — 1 T be s(z) and s 



Itr(S-?) _1 T. Let 



In fact, we have 



s(z) = -(1 - y)z + ys(z). 



Sn{Z) 

1 1 



1 1 ~ ( \ 
^s n {z) 

z z z 

1 1 



(4.22) 



slz 



2 • s \ z > = — + — ■ i 

z z z yz yz 1 — ym{z) 



s(z) = -(1 - y)* + 



1 — ym(z) 
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(4.23) 



where jSAz) = - — , T 1 G 1 — . Therefore, we have 

~, s = ~ z = zl = \ 

z l-yrh(z) ' 

That is, 

s(z) = 



- l z + yfm*)dH(ty 

The proof of the lemma is completed. 
Here we give some notes: 



m(z) = I - x ^— — dH(X) (4.24) 



z l-yrh(z) 

where m(z) is the limit of - S)" 1 and H(t) is the LSD of T. 



—z 11 

S°(z) -> s(z) = — — , 1 + yzs(z) = - — - = 77777^ (4.25) 



t/z-(l+yzs(z)) 

where s(z) is the Stielties transform of the LSD of S _1 T and §2,(z) = — r- — - r — \ — 777- 
with the ESD H n (t) of T. 



Efa{z) l — - = 1 + yzs(z), bi{z) -> l — -r = 1 + yzs(z) (4.26) 

1 — ym{z) 1 — ym{z) 



where = ^^g^^ and b x {z) = ^ n - lEtl ^ T _ Si 



-1 ■ 



—z 



- z(l + yzs(z)) = "77777: = 77777; — • (4.27) 

1 " J t/«-(l+j/«s(«)) 1 " J t-z(l+yzs(z)) 

1 /" d#(t) 1 

- - + V / 7 . . . = — ; — 4.28 

z J t- z(l + yzs(z)) -z{l + yzs(z) v ; 

1 f j-z^fjg^ -(-^(i + ^(z)y 

z 2 y 7 (t-^(l + ^s(z))) 2 (-z(l + y^)) 2 l ' J 

(2(1+ ^ (2))2 •» / ( f + = -(-z(l + yzs(z))> (4.30) 



^ 2 y i (i-z(l +yzs(z))) 2 

w+^'TrSraiS' (431) 

Especially, when T = I p , by f)2.9p . f)4.25p . f)4.20p and the definition of rh(z), we have 

1 + j/zs(z) = — ttt = — m (-) = (1 - y) m -) 

1 + y ■ m{-) z z z z 

and 

m (2) = — m 



* l+J-m(i)) 
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